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BRIEF  DESCRIPTION  OF  PORTFOLIO: 
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design  robustness 

•  Foundations  of  Information  Systems  Research:  Measure,  predict,  and  verify 
information  system  properties 
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Complex  Networks  & 
Foundations  of  Information  Systems 


Goals: 


•  Measure  system  performance  and  calculate  risk 

•  Preserve  critical  information  structure  and  minimize  latency  over  a 
heterogeneous  distributed  network  and  system 

•  Ensure  network  and, system  robustness  and.  resilience  under  a  diverse  set  of 
resource  constraints  and  manage  using  dynamic  models 

•  Represent  global  properties  of  a  networked  system  in  a  unified, 
mathematical  framework  for  architecture  and  design 

•  Assess  and.  Predict  heterogeneous  distributed  systems  performance  using 
unified  mathematical  framework 


Foundations  Goals 


Complex  Networks  Goals 
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Complex  Networks  & 
Foundations  of  Information  Systems 


Payoffs: 


*  Preserve  critical  information  structure  in  a  network  rather  than  just  delivering 
packets  or  bits 

*  Quantify  likelihood  of  a  given  network  management  policy  to  support  critical 
mission  functions 

*  Predict  and  manage  network  and  system  failure  comprehensively 

*  Assess  and  verify  properties  of  a  distributed  heterogeneous  system  where 
there  is  limited  access  to  its  elements 

*  Assess  dynamic  Air  Force  system  mission  performance  and  assess  risk  of 
failure 
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Complex  Networks  and 
Information  Systems  Roadmap 


Complex  Networks  and  Information  Systems  uses  measured  information  to  assure, 
manage,  predict,  and  design  distributed  networks,  systems,  and  architectures 


Heterogeneous  Dynamic 

Air  Force  Systems 


Information  Systems 

Research 

(System  Measurement 
&  Assessment) 


r%  i=> 

*'yi  \  V 


System 

Measurement 


System  Analysis 

&  Prediction 


Complex  Networks 

(Unified  Representation ,  Design , 
Architecture) 


ft 


Global  Network/Svstems 

Research 


Preserve 

Critical 

Information 


Network/Svstems 
Management  Research 


Local  Network/Svstems 

Research 


DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


Information  Systems 
Measurement 


We  wish  to  understand  what  and  how  to  measure  systems  for  representations  that 
are  traceable  to  mission  performance  and  have  quantifiable  risk 


What  to  measure? 
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How  to  measure? 
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System  Measurement 
and  Probabilistic  Model  Checking 

Ed  Clarke,  CMU,  David  Musliner,  SIFT 


Approach:  Techniques  on  what  and  how  to  measure  on  any  software,  network,  and 
hardware  integrated  system  with  probabilistic  model  checking. 

Payoff:  Large  system  state  spaces  can  be  verified  and  risk  calculated  in  a  computationally 
efficient  way. 

Dynamic  System  Toward  Online 

Heterogeneous  Model  of  Critical  System  System  Ana|ysis  with  Measurement 

Systems  Parameters 
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Probabilistic  System  Prediction  and 
System  Risk  Analysis 
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Accurate  Measurement  of 
Systems  Graph  Parameters 

Dan  Speilman,  Yale 

Approach:  There  are  many  different  ways  to  represent  networked  systems.  There  needs  to  be 
a  principled  way  of  selecting  the  best  inputs  for  geometric  models  to  parameterize  system 
performance. 

Payoff:  Systems  can  be  parameterized  in  such  a  way  as  to  minimize  computational  overhead 
and  inaccuracies  in  model  prediction  using  sparse  geometric  graph  theory. 


Critical  Systems 
Information 
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Statistical  System 
Estimation  and  Risk  Analysis 

Eric  Kolaczyk,  Boston  University 


Approach:  Sample  large  systems  guided  by  understanding  of  geometric  invariants  and  risk 
analysis  in  how  measurements  were  constructed. 

Payoff:  Minimum  risk  can  be  incurred  from  measurements  of  large  system  while  still 
sampling  in  most  computationally  efficient  way. 


Minimum  Risk  Outcome  for  Graph  Sampling 


The  Underlying  Network-Graph 
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i. )  Euclidean  geodesic:  7(a)  =  «A  4-  (a  —  1)B. 

ii. )  Log-Euclidean  geodesic:  7(a)  =  exp  (a: A  +  (1  —  a)B) 


9  Let  G  be  a  connected,  undirected  binary  graph 

9  Express  the  relationship  between  G  —  GtrUe  and  G  —  Gobserved ,  in 
terms  of  their  n  x  n  adjacency  matices,  as 

W observed  =  Wtrue  T  Wnojse 

where  Wnojse  captures  Type  I  and  Type  II  errors. 
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Complex  Networks 
System  Representation 


•  We  wish  to  characterize  network  and  system  performance  from  measurement  and 
develop  coding,  protocol,  and  architectures  that  adapt  according  to  network/system  state 
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Network 

Taxonomy 

Narayan,  Saniee  UC  Santa  Cruz/Lucent 


Approach:  Develop  a  taxonomy  of  network  properties  through  curvature  and  timescale 
invariants  from  hyperbolic  geometry 

Payoff:  Space  of  network  models  can  be  developed  and  design  principles  and  analysis 
algorithms  derived  to  predict  network  behavior 

Curvature  vs.  Timescale  and 

Geometric  Curvature  Invariant  Network  Layer 


1.  3-point  “Triangle  test”  -  Are  triangles  universally  8- 
thin? 

■  Select  triangles 

■  For  each  triangle  note  shortest  side  L  and  computed  the  8 

■  Counted  number  of  such  triangles,  indexed  by  Jand  L 
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Entropy  Classes  for  Dynamic 
Network  Models 

>r  Lizhong  Zheng,  MIT 

Approach:  Deriving  models  for  network  protocol  analysis  has  assumed  fixed  protocols 
without  the  benefit  of  feedback  or  dynamic  correlations  in  coding  and  protocol.  Using  Renyi 
correlation  analysis  and  entropy  to  model  this  wider  class  of  models  allows  greater  flexibility 
in  describing  statistical  classes. 


Payoff:  Complex  phenomena  such  as  feedback  in  coding  can  be  modeled  under  dynamic 
heterogeneous  conditions. 


Network  Channel  Architecture 
Feedback  Channel  &  Geometric  Invariants 


Renyi  Channel  Correlation  Analysis 

(connected  to  geometric  curvature) 


•  Maximal  correlation,  a  measure  of  dependence: 
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Feedback  in  Coding  Theory 

D.  Tse,  Berkeley,  P.  Gupta,  Alcatel  Lucent,  D.  Shah,  MIT 

Approach:  Coding  theory  classically  assumes  fixed  statistic  and  fixed  methods  of 
coding  for  a  given  set  of  network  and  interference  conditions 

Payoff:  Feedback  in  coding  methods  can  significantly  improve  throughput  under 
dynamic  network  and  interference  conditions 


Feedback  Coding  Approach 
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Information  Systems 
Assessment 


w 


Predict  system  performance  using  mathematical  invariants  from  measured  data 
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Hodge  Theory  for  Invariants  in  Network  Algorithms 

ST  Yau,  Harvard Ali  Jadbabaie,  UPenn,  Fan  Chung  Graham ,  UCSD 


Approach:  Hodge  decompositions  allow  natural  functional  invariants  to  be  used  on 
extremely  complex  structures 

Payoff:  Analysis  of  Hodge  decomposition  can  be  applied  to  whole  classes  of 
networks  to  characterize  invariant  parameters  and  predict  performance. 

Hodge  Decomposition  Invariant  Analysis  of 

Gives  Powerful  Functional  Invariants  Page  Rank  (Google) 

The  /(-Laplacian  acting  on  Ck(X)  is  defined  by 

Afc  =  dk+1d*k+1  +  d*kdk 


Pageftank  pr(a,s )  =  psD~ll2^$Dm ,  /?  =  la/\_  a 


►  =  0  Qkf  =  0  and  Q *k+1f  =  0 

►  Ck(X)  =  kerA/f  0lm(^+i)  0lm(5J)  is  an  orthogonal 
decomposition  called  the  Hodge  decomposition. 

►  Write  Xe  =  he  +  ge  +  ce 

►  ge  =  Pr°jimd*(Xe):  Gradient  flow 

►  ce  =  projIma2(xe):  Curl  flow 

►  he  =  projieraj/imaf  (Xe):  Harmonic  flow 


Invariant  Analysis  of 
Google's  Page  Rank  Algorithm 
for  Different  Values  of  Beta 


Edge  Pagerank 
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Topological  Invariants  for  Model  Checking 
Network  &  System  Dynamics 

John  Harer/Sayan  Mukherjee  Duke  Konstantin  Mischaikow/Rutgers,  Samson  Abramsky  Oxford,  Peter  Chin  Johns  Hopkins 


Approach:  Dynamic  measured  data  has  correlated  structures  that  are  difficult  to 
characterize  by  standard  tools  in  algebraic  topology  such  as  homology.  Additional  features 
such  as  Conley  index  can  augment  invariants  provided  by  algebraic  topology. 

Payoff:  Dynamic  modes  of  networks  and  networked  systems  can  be  captured  by  new 
methods  in  discrete  Morse  theory  and  algebraic  topology  to  predict  performance 
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Categorical  Invariants  on 
Information  Flows 

Rob  Ghrist,  UPenn 


Approach:  Dynamic  network  information  flow  can  be  parameterized  by  its  max  flow 
min  cut  value  relative  to  the  network  topology 


Payoff:  Categories  of  flows  can  be  developed  using  sheaf  theoretic  formulation  for 
max-flow  min-cut  parameters  to  characterize  and  verify  system  performance 


Sheaf  Formulation  For  Max  Flow  Min  Cut 
and  Network  Code 

{0®F)X - *■  (0®F}CU, 
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=  im  limcuts(0®F)cut-H0®F)pt 
=  limcuts  im(0®F)cut— >(0®F)pt 
=  limcuts[0,cutval] 

[0,mincut]  =  ncuts[0,cutval] 


Categorical  Invariants  For  Coded  Information  Flows 
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Complex  Networks  Transition  Activities 


Complex  Networks  uses  advanced  mathematical  analysis  of  information  systems 
measurements  to  resource,  verify,  and  secure  distributed  Air  Force  infrastructures 

-  Princeton  MURI  -  dynamic  analysis  of  packets  for  airborne  network  resource  management 

-  Yale/Telcordia  commercial  grant  -  real  time  system  security  policy  verification 

-  Columbia/MIT  -  information  theory  for  new  quantum  semiconductors 
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Space  and  Airborne 
Cognitive  RF 

Scott  Erwin,  AFRL/RV,  John  Matyjas,  AFRL/RI,  Vasu  Chakravarthy,  AFRL/RY 


Approach:  Use  advanced  non-parametric  geometric  measurement  and  game  theoretic 
techniques  with  Generalized  Likelihood  ratio  test  to  enable  training  on  RF  interference  data  in 
conjunction  with  advanced  MIMO  beam-forming  techniques  to  remove  interference 


Payoff:  AF  will  be  able  to  conduct  operations  in  crowded  dynamic  spectrum  environment 
Complex  RF  Environment 
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Fig:  The  structure  of  the  GLRT-EC  detector. 
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Quantum  Network  &  System 
Measurements 

Jeff  Yepez/AFRL/RD,  Paul  Alsing/AFRL/RI,  Atilla  Szep,  AFRL/RY 

Approach:  Verification  of  classical  vs.  quantum  states  in  a  network  provides  a  new  class  of 
measurement  problems  which  need  invariants  for  analysis  of  states  of  large  scale  quantum 
systems  for  information  assurance,  communication,  and  computing 

Payoff:  Integrating  new  invariant  network  techniques  with  new  quantum  representations  will 
allow  a  much  more  integrated  way  of  analyzing  large  scale  quantum  network  and 
computational  systems 


Data  from  Quantum 
Network  &  System 
Measurements 
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New  MURI  2012:  Measurement  and  Verification  in  Quantum  Information  Systems 
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Computational  Homology  and  Ricci 
Flow  for  Verification  of  Classical  and  Quantum  States 

Paul  Alsing/AFRL  Rl,  Howard  Bramson/Syracuse,  Warner  Miller >  FAU 


Approach:  Verification  of  classical  and  quantum  states  in  a  network  and  system  provides  a  new  class  of 
measurement  problems  which  need  invariants  such  as  computational  homology  for  analysis  of  states 


Payoff:  Integrating  new  invariant  network  techniques  with  new  classical  and  quantum  representations 
will  allow  a  much  more  integrated  way  of  analyzing  &  securing  large  scale  networked  and  computational 
systems 
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Complex  Networks  Invariants  for  Risk  Assessment 
Measurement  of  Human  vs.  Machine  Performance 

Leslie  Blaha,  AFRL/RH 


Approach:  Complex  Networks  invariants  can  be  used  to  assess  risk  on  human  vs.  machine  operation 
when  faced  with  complex  decision  task. 

Payoff:  Detailed  understanding  and  automation  of  how  to  trade  human  vs.  machine  performance  in  time 
critical  functions  such  as  cyber  security,  autonomous  operation  of  air  vehicles 
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Recent  Program  Awards 


*  Dan  Speilman 

-  MacArthur  Genius  Award  (2012) 

*  Ingrid  Daubechies 

-  Fellow  of  the  American  Mathematical  Society  2012 

-  Benjamin  Franklin  Institute  Medal,  2012 

-  Leroy  Steel  Prize  From  American  Mathematical  Society  2012 

-  IEEE  Jack  Kirby  Signal  Processing  Medal  2011 

*  Robert  Calderbank 

-  IEEE/Hamming  Medal  Winner  (2012) 

*  Vincent  Poor 

-  National  Academy  of  Science  (2011) 

*  Emmanuel  Candes: 

-  Collatz  Prize  (Mathematics) ,  (ICIAM)  (2011) 

-  Winner,  Sixth  Vasil  A.  Popov  Prize  (Mathematics)  ,(2010) 

*  ST  Yau 

-  Wolf  Prize  Mathematics,  2010 

*  Joel  Tropp: 

-  Eighth  Monroe  H.  Martin  Prize,  2011 

*  Yonina  Eldar 

-  IEEE  Fellow  2013 

*  Mung  Chiang: 

-  IEEE  Fellow  2012 

-  IEEE  Kiyo  Tomiyasu  Award  in  2012 

*  Junshan  Zhang 

-  IEEE  Fellow  2012 


DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


Academia/Commercial  Outreach  ^ 


*  Keynote  Lecture,  American  Society  of  Mechanical  Engineers,  Complex 
Systems  2012 

*  Keynote  Lecture,  International  Conference  on  Complex  Networks, 
2012 

*  Keynote  Lecture,  IEEE,  CogSima,  2013 

*  Invited  Lecture,  Yale  Mathematics,  Anniversary  of  Coifman,  Jones, 
Rokhlin  Achievements 

*  Organizer:  London  Institute  of  Mathematics:  Mathematics  of  on 
Statistical  Verification,  March  2012 

*  Organizer,  OSTP  Meeting  on  Complex  Engineered  Systems,  2012 

*  Invited  Speaker,  Allerton,  IEEE  Conference  on  Information  Theory, 
University  of  Illinois  2012 

*  Invited  Speaker,  IDGA  Big  Data,  Federal  Meeting  Washington  DC,  2013 

*  Invited  Speaker,  Neuro-Information  Processing,  Lake  Tahoe,  2012 

*  Invited  Speaker:  Dagstuhl  Germany,  Mathematics  of  Information  Flow, 
2012 

*  jnvited  Speaker:  USCD  Information  Theory  and  Applications,  LaJolla 
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Program  Impact  & 
Collaboration  with  Agencies 


•  OSTP/NITRD  -  Co-Chair  Large  Scale  Networks  Working  Group 

-  New  national  thrust  -  Complex  Networks  and  Systems  inspired  by  AFOSR 
program  -  Workshop  "Complex  Engineered  Networks"  organized  by  leader  of 

AFOSR  Complex  Networks  MURI  "Information  Dynamics  in  Networks" 

•  ASDR&E 

-  Engineered  Resilient  Systems  -  Complex  Networks  and  Foundations  of 
Information  Systems  on  Roadmap 

•  DARPA  Collaboration/joint  program  reviews 

-  Graphs  -  Mathematics  of  graphs  and  networks  agent 

-  Defense  Science  Office  Mathematics  Advisory  Panel 

-  InPho  -  Information  in  a  photon/quantum  network  collaborative  funding 

-  Com-EX  cognitive  network  program  transition  agent 

•  IARPA  -  Quantum  Computer  Science  Working  Group 

•  ARL/ARO  Network  Science  Board  of  Advisors 

•  NSF  Future  Internet,  Cyber  Physical  Systems 
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<*•* 


Complex  Networks  Trends 


•  Local  Network  Theory 

-  Geometric  and  binary  information  coding  -► 

-  Coding  information  with  network  performance  objectives  ^ 

—  Integration  with  verification  and  quantum  methods  | 

•  Network  Management 

-  Nonparametric  strategies  for  assessing  network  performance  / 

—  Distributed  strategies  for  measuring  and  assessing  network  information 
transfer 

-  Sparse  network  management  * 

•  Global  Network  Theory 

-  Geometric  flow  analysis  for  prediction  and  management  of  network 
performance 

-  Global  state  space  taxonomy  and  categorization  4 

•  Information  Systems  Research 

-  Combined  network,  software,  and  hardware  analysis  4 

-  Defining  correct  input  data  for  given  mathematical  assessment 

-  Invariant  metrics  for  analysis  of  network  performance  | 
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Other  Program  Interactions 


w 


Cyber  Operations:  Joint  University  Center  of  Excellence: 

"Cyber  Vision  2025"  -  Enabling  Technologies  workshops 
"Secure  Cloud  Computing"  with  university  and  AFRL/RI 

Dynamics  and.  Control :  Verification  and  Validation  of  Complex  Systems 

Physics  and_  Materials :  New  Joint  MURI  Topic:  "Large  Scale  Integrated 
Hybrid  Nanophotonics" 

Socio-Cultural Analysis :  Social  Networks- Joint  MURI  Topic:  "Stable 
Metrics  for  Inference  in  Social  Networks  "  -  UCLA/USC/ASU 

Quantum:  Interaction  with  quantum  network  and  quantum  estimation 
processes  through  lab  tasks 

-  Joint  EOARD  initiative  at  Cambridge 

Ijifgnriation  Fusion:  Critical  feature  selection  in  sensor  networks 
Optimization:  Competing  optimization  requirements. 

Decision:  Networks  of  neurons. 

Biojogy:  Systems  biological  processes  as  networks. 
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Transition  Activities 


•  AFRL 

-  AFRL/RI  -  Cyber  Vision  2025  workshops/Illinois  Center  for  Secure 
Cloud  Computing/ 

-  AFRL/RI/RY  -  DARPA  InPho  program/DARPA  Graphs  program 

-  AFRL/RI/RY/RV- distributed  secure  space  communications 

-  AFRL/RW/RV/RH  -  verification  and  validation  of  complex  systems 


•  STTR 

-  Intelligent  Automation:  Transition  to  ESC  of  Airborne  Networks 
management  -  transition  to  Boeing  for  test-bed 

-  Avirtek:  Secure  router  application  interface-  AFRL/RI 

-  Andro  -  Joint  Spectrum  Center  Lockheed  transition  of  automated 
spectrum  management  tool 
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Transition  Activities 


•  Customer/Industry 

-  Collaboration  with  ACC/GCIC,  Air  Force  Spectrum  Management 
Agency  on  JALIN  ICD 

-  Collaboration  with  Boeing,  ESC,  IAI  for  transition  of  coding  and 
routing  management  protocols  baseline  CORE  tools  to  Rome 
Lab  for  possible  integration  in  CABLE  JCTD 

-  Briefing  to  Space  Command/Peterson  for  potential  collaboration 

-  Interaction  with  Northrop  Grumman/BACN  airborne  networking 
program  for  potential  collaboration 

•  OSD 


-  Complex  Systems  Engineering  and  Systems  20/20  initiative 

-  Software  Assurance  and  Security  Initiative 

-  Robust  Command  and  Control  Initiative 


•  Commercial 


-  Interaction  with  Stanford  on  real  time  network  information 
recovery 

-  New  initiatives  with  Akamai  for  content  distribution  analysis 

-  Interaction  with  USFA/DHS/CISCO  on  router  algorithm  design 
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